Interpretable Optimal Stopping
نویسندگان
چکیده
Optimal stopping is the problem of deciding when to stop a stochastic system obtain greatest reward, arising in numerous application areas such as finance, healthcare, and marketing. State-of-the-art methods for high-dimensional optimal involve approximating value function or continuation then using that approximation within greedy policy. Although policies can perform very well, they are generally not guaranteed be interpretable; is, decision maker may able easily see link between current state policy’s action. In this paper, we propose new approach wherein policy represented binary tree, spirit naturally interpretable tree models commonly used machine learning. We show class rich enough approximate formulate learning from observed trajectories sample average (SAA) problem. prove SAA converges under mild conditions size increases but that, computationally, even immediate simplifications theoretically intractable. thus tractable heuristic approximately solving by greedily constructing top down. demonstrate our applying it canonical option pricing, both synthetic instances real Standard & Poor’s 500 Index data. Our method obtains (1) outperform state-of-the-art noninterpretable methods, based on simulation regression martingale duality, (2) possess remarkably simple intuitive structure. This paper was accepted Chung Piaw Teo, Management Science Special Section Data-Driven Prescriptive Analytics.
منابع مشابه
Optimal Stopping Problems
In the last lecture, we have analyzed the behavior of TD(λ) for approximating the costtogo function in autonomous systems. Recall that much of the analysis was based on the idea of sampling states according to their stationary distribution. This was done either explicitly, as was assumed in approximate value iteration, or implicitly through the simulation or observation of system trajectories...
متن کاملOptimal Stopping and Applications
These notes are intended to accompany a Graduate course on Optimal stopping, and in places are a bit brief. They follow the book ‘Optimal Stopping and Freeboundary Problems’ by Peskir and Shiryaev, and more details can generally be found there.
متن کاملTwo Choice Optimal Stopping∗†
Let Xn, . . . , X1 be i.i.d. random variables with distribution function F . A statistician, knowing F , observes the X values sequentially and is given two chances to choose X’s using stopping rules. The statistician’s goal is to stop at a value of X as small as possible. Let V 2 n equal the expectation of the smaller of the two values chosen by the statistician when proceeding optimally. We o...
متن کاملOptimal Stopping under Ambiguity
We consider optimal stopping problems for ambiguity averse decision makers with multiple priors. In general, backward induction fails. If, however, the class of priors is time–consistent, we establish a generalization of the classical theory of optimal stopping. To this end, we develop first steps of a martingale theory for multiple priors. We define minimax (super)martingales, provide a Doob–M...
متن کاملOptimal Stopping Constants
k) , t h e n t h e o p t i m a l s t r a t e g y i s t o r e j e c t t h e fi r s t m − 1 a p p l i c a n t s a n d a c c e p t t h e n e x t c a n d i d a t e , w h e r 1 ] c a l c u l a t e d t h e a s y m p t o t i c p r o b a b i l i t y o f s u c c e s s t o b e [ 1 2 ,
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Management Science
سال: 2022
ISSN: ['0025-1909', '1526-5501']
DOI: https://doi.org/10.1287/mnsc.2020.3592